ON A SURPRISING RELATION BETWEEN RECTANGULAR AND 
SQUARE FREE CONVOLUTIONS 
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Abstract. Debbah and Ryan have recently DR07 proved a result about the limit empirical 
singular distribution of the sum of two rectangular random matrices whose dimensions tend to 
infinity. In this paper, we reformulate it in terms of the rectangular free convolution introduced 
in |BG07b| and then we give a new, shorter, proof of this result under weaker hypothesis: we 
do not suppose the probability measure in question in this result to be compactly supported 
anymore. At last, we discuss the inclusion of this result in the family of relations between 
rectangular and square random matrices. 

Oh ■ Introduction 

Free convolutions are operations on probability measures on the real line which allow to com- 
pute the spectral or singular empirical measures of large random matrices which are expressed 
as sums or products of independent random matrices, the spectral measures of which are known. 
More specifically, the operations EH, H, called respectively free additive and multiplicative convo- 
lutions are defined in the following way [VDN91J . Let, for each n, M n , N n be n by n independent 
random hermitian matrices, one of them having a distribution which is invariant under the action 
of the unitary group by conjugation, which empirical spectral measuresj converge, as n tends 
to infinity, to non random probability measures denoted respectively by n , r-i. Then t\ EEI t<i 
is the limit of the empirical spectral law of M n + N n and, in the case where the matrices are 
positive, T\ E3 t 2 is the limit of the empirical spectral law of M n N n . In the same way, for any 
A G [0, 1], the rectangular free convolution EEI^ is defined, in [BG07b] . in the following way. Let 
M n> p, N n ^ p be n by p independent random matrices, one of them having a distribution which is 
invariant by multiplication by any unitary matrix on any side, which symmetrizedj empirical 
singular measureaj tend, as n,p tend to infinity in such a way that n/p tends to A, to non random 
probability measures v\ , v 2 ■ Then the symmetrized empirical singular law of M njP + N np tends 
to vt EE! A v 2 . 
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The empirical spectral measure of a matrix is the uniform law on its eigenvalues with multiplicity. 
The symmetrization of a probability measure fj, on [0, +00) is the law of eX, for e,X independent random 
variables with respective laws 1 2 -1 , fi. Dealing with laws on [0, +00) or with their symmetrizations is equivalent, 
but for historical reasons, the rectangular free convolutions have been defined with symmetric laws. In all this 
paper, we shall often pass from symmetric probability measures to measures on [0, +00) and vice-versa. Thus in 
order to avoid confusion, we shall mainly use the letter /j, for measures on [0, 00) and v for symmetric ones. 

3 The empirical singular measure of a matrix M with size n by p (n < p) is the empirical spectral measure of 
\M\ := VMM*. 
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These operations can be explicitly computed using either a combinatorial or an analytic 
machinery (see [VDN91] and |NS06j for EB, M and |BGn7bj for EB A ). In the cases A = or A = 1, 
i.e. where the rectangular random matrices we consider are either "almost flat" or "almost 
square", the rectangular free convolution with ratio A can be expressed with the additive free 
convolution: EBi = EB and for all symmetric laws v\,vi, v\ EBo V2 is the symmetric law which 
push-forward by the map t i— > t 2 is the free convolution of the push forwards of v\ and vi by 
the same map. However, though one can find many analogies between the definitions of EB and 
EB A and still more analogies have been proved [BG07aJ, no general relation between EB A and EB 
had been proved until a paper of Debbah and Ryan IDR07] (which submitted version, more 
focused on applications than on this result, is |DR08| ). It is to notice that this result is not 
due to researchers from the communities of Operator Algebras or Probability Theory, but to 
researchers from Information Theory, working on communication networks. In [DR07J, Debbah 
and Ryan proved a result about random matrices which can be interpreted as an expression, for 
certain probability measures v\, V2, of their rectangular convolution v\ E\\ vi in terms of EB and 
of another convolution, called the free multiplicative deconvolution and denoted by H. In this 
note, we present this result with a new approach and we give a new and shorter proof, where 
the hypothesis are more general. This generalization of the hypothesis answers a question asked 
by Debbah and Ryan in the last section of their paper |DR07j . The question of a more general 
relation between square and rectangular free convolutions is considered in a last "perspectives" 
section. 

Acknowledgments: The author would like to thank Raj Rao for bringing the paper DR07J 
to his attention and Merouane Debbah for his encouragements and many useful discussions. 

1. The result of Debbah and Ryan 

Let us define the operation H on certain pairs of probability measures on [0, +oo) in the 
following way. For p,p2 probability measures on [0, +oo), if there is a probability measure on 
[0, +oo) such that p = p,\ M p2, then p\ is called the free multiplicative deconvolution of p by p2 
and is denoted by p,% = pElp2- Let us define, for A € (0, 1], p\ be the law of AX for X random 
variable distributed according to the Marchenko-Pastur law with parameter 1/A, i.e. the law 
with support [(1 — vA) 2 , (1 + vA) 2 ] and density 

J AX - (x - 1 - A) 2 

x h^ -^ . 

2ir\x 

Theorem 1 of [DR07] states the following result. A £ (0, 1] is fixed and (p n ) is a sequence of 
positive integers such that n/p n tends to A as n tends to infinity. 5\ denotes the Dirac mass at 
1. 

Theorem 1 (Debbah and Ryan). Let, for each n, A n , G n be independent n by p n random 
matrices such that the empirical spectral law of A n A* n converges almost surely weakly, as n tends 
to infinity, to a compactly supported probability measure pa and such that the entries of G n are 
independent N(0, -p) random variables. Then the empirical spectral law of (A n + G n )(A n + G n )* 
converges almost surely to a compactly supported probability measure p which, in the case where 
^H/iA exists, satisfies the relation 

(1) p=[(p jA mp x )S5 1 }m f i x . 

Remark 2. Note that in the case where pa^Px doesn't exist, the relation ([T]) stays true in 
the formal sense. More specifically, for pa probability measure such that pa^Px exists, the 
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moments of p = [(pa^Px) EB S\] Kl p\ have a polynomial expression in the moments of pa (this 
can easily be seen by the theory of free cumulants [NS06] ). It happens that this relation between 
the moments of the limit spectral law p of (A n + G n )(A n + G n )* and the ones of pa stays true 
even when pA^px doesn't exist. It follows from the original proof of Theorem [T] and it will also 
follow from our proof (see Remark [3]). 

Note that by the very definition of the rectangular free convolution E\\ with ratio A recalled 
in the introduction and since the limit empirical spectral law of GG* is p\ (it is a well known 
fact, see, e.g. Theorem 4.1.9 of |HP00j ). this result can be stated as follows: for all compactly 
supported probability measure p on [0, +oo) such that pnp\ exists, 

(2) (^jim x ^i x -) 2 = [(pKp x )m5 1 }®px, 

where for any probability measure p on [0,+oo), ^fp denotes the symmetrization of the push- 
forward by the square root functions of p and for any symmetric probability measure v on the 
real line, v 2 denotes the push- forward of v by the function t \—> t 2 . This formula allows to express 
the operator S\y/p\ on the set of symmetric compactly supported probability measures on the 
real line in terms of EB and M: for all symmetric probability measure on the real line v, 



(3) v EB A ^ = yJ[{u 2 Up x )m5 l ] 



I^A- 



2. A PROOF OF THE GENERALIZED THEOREM OF DEBBAH AND RYAN 

A € (0, 1] is still fixed. In this section, we shall give a new shorter proof of the theorem of 
Debbah and Ryan, under weaker hypothesis: we shall prove ([3]) without supposing the support 
of v to be compactly supported. The proof is based on the machinery of the rectangular free 
convolution and of the rectangular i?-transform. 

2.1. Some analytic transforms. Let us first recall a few facts about the analytic approach to 

M and ES^. Let us define, for p probability measure on [0, oo), 

M p (z):=[ j^-dpit), Sp (s) = ^M(- 1 \z), 

JteR l — zt z 

where, as it shall be in the rest of the text, the exponent '~ 1 ' stands for the inversion of analytic 
functions on C\[0, +oo) with respect to the composition operation o, in a neighborhood of zero. 
By |VDN91] . for all pair pi, p2 of probability measures on [0, +oo), p\ IE1 p2 is characterized by 
the fact that S^®^ = S^S^. 

In the same way, the rectangular free convolution with ratio A can be computed with an 
analytic transform of probability measures. Let i^bea symmetric probability measure on the 
real line. Let us define H u (z) = z{\M v 2{z) + l)(M u 2(z) + 1). Then the rectangular R-transform 
with ratio A of v is defined to be 

C v {z) = U ( * - 1 ) , 

where U{z) = — ^\ — • By theorem 3.12 of [BG07b] . for all pair v\, V2 of symmetric 

probability measures, v\ S\ V2 is characterized by the fact that C V1 ^ XV2 = C Ul + C U2 . 
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2.2. Some preliminary computations. Note that by |NS06j . the S- and /^-transforms of 

a probability measure [i on [0, +00) are linked by the relation 5 M (s) = -R^ (z), thus since 
the free cumulants of the Marchenko-Pastur law with parameter 1/A are all equal to 1/A (see 
[NSDB]), we have S^{z) = j^. Moreover, since by [Ng06] again, S^s) = I±2M^ _1> (z), for 
any law a on [0, +00), 



M 



(-1) 



M), 



<-i> 



^d M^ =(l + Xz)M<- 1 l 



^ ' ~««sma z + l l + \ z l + \z 

At last, since EB<5i = *5\, which implies that M ff g^ (z) = [(z + l)M a (z) + z] o -^-p for any 
symmetric law v, we have 



(5) 



M, 



1 



((i^kmaJWOBWa " 1 + Az " 1 + 



z + 1) (1 + Az)M 



,2 



<-i> 



+ z 



<-i> 



2.3. Proof of the result. So let us consider a symmetric probability measure v such that 
y 2 Ufi\ exists and let us prove ©. As proved in the proof of Theorem 3.8 of |BG07b| . for any 
symmetric probability measure r, H T characterizes r, thus it suffices to prove that H u ^ x rjj^ = 

H m for m = a/[(z/ 2 eI/Ua) EB S\] M fi\. By Theorem 4.3 and the paragraph preceding in |BG07aj . 
Cnj^{z) = z. Thus Lemma 4.1 of [BBA07J applies here, and it states that in a neighborhood of 

zero in C\[0, +00), 

( H v ^ { - 1] 



T(H U + M u2 
where T(z) = (Xz + l)(z + 1). So it suffices to prove that in such a neighborhood of zero, 



H„ 



H„o 



H rj 



<-i> 



i.e. H m o 



H„ 



H„ 



T(H V + M V 2)J T{H U + M U 2 

Using the fact that for any symmetric law r, H T (z) = zT(M T 2(z)), it amounts to prove that 



T(H U + M v 



i.e. 



x T o M m 2 o 



H„ 



T(R V + M v 



Hv(z), 



ToM - 2 °n Hu+ M U 2 



T{H v {z) + M^{z)), 



which is implied, simplifying by T and using again H T (z) = zT(M T 2(z)), by 

zT(M u 2(z)) 



M m 2 o 



T[zT{M v 2(z)) + M v 2{z)} 



zT\M v 2{z)} + M u 2{z) 



It is implied, composing by M \ on the right and by M 2 on the left, by 

M { ~ 1) xT = (Tx M { J ] ) (M^\z)T(z) + z). 
Using the expression of M 2 given by ([5]), it amounts to prove that 

M^\z)T(z) = 



+ l)x 



l + z 



(z + l)((l + Az)M<- 1) ) 



(-1) 



+ z 



<-i> x 



o(M<- 1) (z)T(z) + z), 
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i.e. that 



r(-l> 



My>{z)T{z) 



My ) {z)T{z) + z + l 1+z 



Now, composing by 



i: + i)((l + Xz)M^ V} ) { 1} +z 



<-i> 



(-1) 



o{M { , 1 \z)T{z)+z). 



{z + l)((l + \z)M { - l) ) + 



j^ on the left, it gives 



(z + 1) ((1 + A^M^ 1 



(-i> 



+ z 



r<"i> 



<-!>» 



o [(1 + \z)Myi{z)\ = M^ L >{z)T{z) + z 



i.e. 



[M< 2 1} (z)(Az + 1) + l]z + [M^ 1} (z)(Az + 1)] = M<~ 1} (z)(Az + l)(z + 1) + z, 
which is easily verified. 



2.4. Remarks on this result. 

Remark 3. Note that we did not use the fact that ^ 2 H/Ua exists to prove that H, 



I'ttWMA 



H„ 



It means that if v Q/xa doesn't exist, there is no more probability measure /i on [0, +oo) such 



r(-i> 



r("l> 



that M^ = (l + Az)Af 2 as in ([3]), but the polynomial expression of the moments of uS\ JJJl\ 
(i.e. of the limit symmetrized singular law of the matrix A n + G n of Theorem [1]) in the moments 
of v following from H u ^ x /j^ = H m for m = \/[(u 2 s^lx) H #i] ^ A 4 a stays true (see Remark [2]). 



Remark 4 (Case A = 0). A continuous way to define [i\ for any A G [0,1] is to define it to 
be the probability measure with free cumulants k n (/j,\) = A 1 ^™ for all n > 1 (see [NSQ6]). This 
definition gives hq = 5\. Note that by definition of the rectangular free convolution with null 
ratio EBo (which is recalled in the introduction), the relation ([3]) stays true for A = 0. 



Remark 5. Note that the original proof of Debbah and Ryan in DR07J is based on the combi- 
natorics approach to freeness, via the free cumulants of Nica and Speicher [NS06J , whereas our 
proof is based on the analytical machinery for the computation of the rectangular i?-transform, 
namely the rectangular i?-transform. It happens sometimes that combinatorial proofs can be 
translated on the analytical plan by considering the generating functions of the combinatorial 
objects in question. Notice however that it is not what we did here. Indeed, the rectangular R- 
transform machinery is actually related to other cumulants than the ones of Nica and Speicher. 
These are the so-called rectangular cumulants, defined in [BG07bJ. 

2.5. Remarks about the free deconvolution by fx\. The following corollary is part of the 
answer given in the present paper to the question asked in the last section of the paper of Debbah 
and Ryan [DR07] . Let us endow the set of probability measures on the real line with the weak 
topology [B68| . 

Corollary 6. The functional v h^ [(^ 2 h/xa) EB<5i] KI/Xaj defined on the set of probability measures 
v on [0, +oo) such that un^x exists, extends continuously to the whole set of probability measures 
on [0, +oo). 

Proof. We just proved, in section [273| that the formula 



^t±JA V/"a 



V[(i/ 2 H/z A )ffl£i] 



i Ma 



is true for any probability measure v on [0, +oo). Since the operation EBa is continuous on the set 
of symmetric probability measures on the real line (Theorem 3.12 of [BG07bj ) and the bijective 
corespondance between symmetric laws on the real line and laws on [0, +oo), which maps any 
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symmetric law to its push- forward by the map t i— ► t 2 , is continuous with continuous inverse, 
the corollary is obvious. □ 

The functional Sfi\, which domain is contained in the set of probability measures on [0, +00), 
plays surprisingly a key role here. It seems natural to try to study its domain. The first step 
is to notice that this domain is the whole set of probability measures on [0, +00) if and only 
if <5i is in this domain, and that in this case, the functional h//a is simply equal to K(5iH/U\)- 
However, the following proposition states that despite the previous corollary, the domain of the 
functional H/^a is not the whole set of probability measures on [0, +00). 

Proposition 7. The Dirac mass 5± at 1 is not in the domain of the functional H/x^. 

Proof. Suppose that there is a probability measure r on [0, +00) such that 5\ = r Kl fix- 
Such, a law r has to satisfy S T (z) = 1 + Xz. It implies that for z small enough, M T (z) = 

— |v — • Such a function doesn't admit any analytic continuation to C\[0, +00), thus 

no such probability measure r exists. □ 

3. Relations between square and rectangular matrices/convolutions 

The theorem of Debbah and Ryan gives an expression of the empirical singular measure of 
the sum of two rectangular random matrices in terms of operations related to hermitian square 
random matrices. Two other results relate empirical singular measures of (non hermitian) square 
or rectangular random matrices to the operations devoted to hermitian random matrices. 

The first one can be resumed by Eli = EEL Concretely, it states that denoting by ESM(X) the 
symmetrization of empirical singular measure of any rectangular matrix X, for any pair M, N 
of large n by p random matrices, one of them being invariant in law by the left and right actions 
of the unitary groups, for n/p ~ 1, 

(6) ESM(M + N) ~ ESM(M) EE! ESM(iV) . 

Note that the matrices M, N are not hermitian, which makes pretty surprising (since EB 
was defined with hermitian random matrices). It means that for e, £\,S2 independent random 
variables with law -^ — ~ independent of M and N, we have 

(7) Spectrum(e|M + A^|)~Spectrum(ei|M| +e 2 |iV|) 

The second one can be resumed by for any pair u, r of symmetric probability measures on the 
real line, (y EElo r) 2 = v 2 EB r 2 Concretely, it states that for any pair M, N of n by p unitarily 
invariant random matrices, for 1 << n « p, 

(8) Spectrum[(M + N)(M + iV)*]~ Spectrum(MM* + NN*). 

The advantage of the result of Debbah and Ryan on those ones is that it works for any value 
of the ratio A, but its disadvantage is that it only works when one of the laws convoluted is 
[j,\, i.e. one of the matrices considered is a Gaussian one. In fact this sharp restriction can 
be understood by the fact that among rectangular random matrices which are invariant in law 
under multiplication by unitary matrices, the Gaussian ones are the only ones which can be 
extended to square matrices which are also invariant in law under multiplication by unitary 
matrices. 

It could be interesting to understand better how relations like dZJ), dEJ) or like the one of 
the Debbah and Ryan's theorem work and can be generalized. Unfortunately, until now, even 
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though nice proofs (see [BG07bj for (J7J) and (|8|) or Theorem 4.3.11 of [HPOOJ and Proposition 3.5 
of [HLOOj for the n = p case of (J7|)) relying in free probability have been given for these results 
relating rectangular convolutions and "square non hermitian convolutions" with the "square 
hermitian convolution" (i.e. EH), no "concrete" explanation has been given, and no generalization 
(to any A, to any pair of probability measures) neither. Such a generalization could be the given 
of a functional f\ on the set of symmetric probability measures such that for all v, r symmetric 
probability measures, v EEI A r is the only symmetric probability measure satisfying 

/ A (i/ffl A r) = / A (*/)EB/ A (r). 

Note that in the case A = 1, the functional f\(y) = v works, and in the case A = 0, the functional 
which maps a measure to its push- forward by the square function works. 

Remark 8. Let (A, (p) be a *-non commutative probability space and pi,P2 be two self-adjoint 
projectors of A such that p\ + P2 = 1 such that A = <p(p\) / Vfe) • As explained in Proposition- 
Definition 2.1 of [BG07b], EEI A can be defined by the fact that for any pair a,b £ p\Api free with 
amalgamation over Yect(pi,p2), the symmetrized distribution of \a + b\ in (piApi, }_ \ <P\ pi Api) 
is the rectangular free convolution with ratio A of the symmetrized distributions of \a\ and \b\ 
in the same space. 

Moreover, it is easy to see that for all a S p±Ap2, the symmetrized distribution r of \a\ in 
(piApi, } -j V^pi^pi) is linked to the distribution v of a + a* in (A, if) by the relation v = 

T+^ + t+aV 

When A = 1, the equation EEI = EB A can be summurized in the following way: for a,b £ p\Ap2 
free with amalgamation over Vect(pi,p2)> the distribution of (a + b) + (a + b)* in (A, (p) is the 
free convolution of the distributions of a + a* and b + b* . 

If this had stayed true for other values of A, it would have meant that for all v, t compactly 
supported symmetric probability measures on the real line, we have 



(9) / a (*/EB a t) = / a (*/)EB/ a (t), 

nn +1-1/3 Tool lmo -ir\ ...... , . „ _., 

l+A' ^ 1+A 1 



where f\ is the function which maps a probability measure r on the real line to ttt t + tta^o- 



But looking at fourth moment, it appears that ([9]) isn't true. 
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